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Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

Claims 1,13-15 and 18 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Vaithilingam et al. (6,41 1 ,724). 

As to claim 1, Vaithilingam teaches a multi media compressed or uncompressed 
data description scheme, .D.S., comprising the steps of; 

Extracting distinctive features from compressed or uncompressed data, 
assigning descriptors, clustering the data based on descriptors and hierarchically 
describing the multi media meta data (Fig. 2). 

According to Vaithilingam the audio feature hierarchical description scheme of audio 
data is explained on Col.11, lines 15-45. 

" General requirements for descriptors and description schemes as proposed in the 
aforementioned MPEG-7 Requirements Document are supported by suitable 
descriptors and their meta-descriptors. Multiple types of features-suitable descriptors 
and their meta-descriptors support multimedia descriptions using various types of 
features such as: N-dimensional Spatio-temporal structure (e.g., the duration of a music 
segment), objective features (e.g., the number of beds in a hotel, color of an object, 
shape of an object, audio pitch, etc.), subjective features (e.g., how nice, happy or fat 
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someone is, topic, style, etc.), production features (e.g., information about document 
creation such as the date of acquisition, producer, director, performers, roles, 
production company, production history, any non-IPMP production information), 
composition information (e.g., how a scene is composed, editing information, the user's 
preferences, etc.), and concepts (e.g., event, activity). Abstraction levels for the 
multimedia material -hierarchical mechanism to describe multimedia documents at 
different levels of abstraction are supported, which accommodates users' needs for 
information at differing levels of abstraction such as. for example, the composition of 
objects from sub-objects, a sequence by sequence analysis of motion in a video, and 
the plot structure of a video. Cross-modality-audio, visual, or other descriptors and their 
meta-descriptors that allow queries based on visual descriptions to retrieve audio data 
and vice versa are supported (for example, where the query is an excerpt of Pavarotti's 
voice and the result is retrieval of video clips where Pavarotti is singing and where 
Pavarotti is present). Multiple descriptions-the ability to handle multiple descriptions of 
the same material at several stages of its production process is supported, as well as 
descriptions that apply to multiple copies of the same material. Description scheme 
relationships-suitable description schemes express the relationships between 
descriptors and their meta-descriptors to allow for their use in more than one description 
scheme. The capability to encode equivalence relationships between descriptors and 
their meta-descriptors in different description schemes is supported. Descriptor 
priorities-the prioritization of descriptors and their meta-descriptors preferably is 
supported by the description schemes so that queries may be processed more 
efficiently. The priorities may reflect levels of confidence or reliability. Descriptor 
hierarchy -suitable description schemes support the hierarchical representation of different 
descriptors and their meta-descriptors in order that queries may be processed more 
efficiently in successive levels where N level descriptors complement (N-1) level 
descriptors. Descriptor scalability-suitable description schemes support scalable 
descriptors with their meta-descriptors in order that queries may be processed more 
efficiently in successive description layers. Description of temporal range-association of 
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descriptors with their meta-descriptors to different temporal ranges are supported, both 
hierarchically (descriptors with their meta-descriptors are associated to the whole data 
or a temporal sub-set of it) as well as sequentially (descriptors with their meta- 
descriptors are successively associated to successive time periods). Description 
hierarchy (Col.11. lines 55-65). 

As to claim 13, Vaithilingam teaches where multiple key feature are created and 
described 

" Functional requirements for descriptors and description schemes as proposed in the 
aforementioned MPEG-7 Requirements Document are supported by suitable 
descriptors and their meta-descriptors. Retrieval effectiveness-the effective retrieval of 
multimedia material is supported. Retrieval efficiency-the efficient retrieval of 
multimedia material is supported. Similarity-base retrieval-descriptions allowing to rank- 
order database content by the degree of similarity with the query are supported. 
Associated information-the association of other information with the data is supported. 
Streamed and stored descriptions-both (synchronized with content) and non 
Functional requirements for descriptors and description schemes as proposed in the 
aforementioned MPEG-7 Requirements Document are supported by suitable 
descriptors and their meta-descriptors. Retrieval effectiveness~the effective retrieval of 
multimedia material is supported. Retrieval efficiency-the efficient retrieval of 
multimedia material is supported. Similarity-base retrieval-descriptions allowing to rank- 
order database content by the degree of similarity with the query are supported. 
Associated information-the association of other information with the data is supported. 
Streamed and stored descriptions— both Streamed (synchronized with content) and 
non Streamed data descriptions are supported." (Col. 12, lines 15-26). 

With respect to claims 14-15 and 18, Vaithilingam teaches where multiple 
attachments to describe the feature indicative of event and object as well as the level of 
the feature created are used. 
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According to Vaithilingam " During extraction, features from a multimedia 
content may be combined, if desired, with liiglier level semantic information to 
determine the values in the meta-descriptor. For example, where the multimedia content 
is an image, features from the image are combined with semantic information from the 
text caption associated with the image to determine the values in the meta-descriptor for 
the image." 

And further " General requirements for descriptors and description schemes as 
proposed In the aforementioned MPEG-7 Requirements Document are supported by 
suitable descriptors and their meta-descriptors. Multiple types of features-suitable 
descriptors and their meta-descriptors support multimedia descriptions using various 
types of features such as: N-dimensional Spatio-temporal structure (e.g., the duration of 
a music segment), objective features (e.g., the number of beds in a hotel, color of an 
object, shape of an object, audio pitch, etc.), subjective features (e.g., how nice, happy 
or fat someone is, topic, style, etc.), production features (e.g., information about 
document creation such as the date of acquisition, producer, director, performers, roles, 
production company, production history, any non-IPMP production information), 
composition information (e.g., how a scene is composed, editing information, the user's 
preferences, etc.), and concepts (e.g., event, activity). Abstraction levels for the 
multimedia material-hierarchical mechanism to describe multimedia documents at 
different levels of abstraction are supported, (Col. 11, lines 15-30). 

Allowable Subject Matter 

Claims 7, 9, 16, 17, and 19-26 are allowed. 

Claims 2-6 and 10-12 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Daniel D. Abebe whose telephone number is 571-272- 
7615. The examiner can normally be reached on monday-friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on 571-272-7843. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more infonnation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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